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(54) [MAGE PROJECTION SYSTEM 

(57)Abstract: 

PROBLEM TO BE SOLVED: To obtain a projection 
picture of high definition utilizing the resolution of input 
data. 

SOLUTION: In this system, high-definition picture data 
generated and outputted by a personal computer 1 is 
inputted to the picture processing and dividing part 4 of 
a controller part 3. This part 4 decides a part of data 2 
to be outputted to each of projectors 7a to 7d based on 
a parameter previously stored in a projector 
arrangement storage part 5 and implements a prescribed 
processing. The signal of the part 4 is inputted to a 
plurality of D/A conversion parts 6 to be converted to 
an analog signal by the part 6 and then the picture is 
projected on a screen 8 by each of projectors 7a to 7d. 
The projected picture projected on the screen 8 in this 
way becomes a high-definition picture in which each 
picture is accurately positioned. 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The image projection system characterized by providing an image generation means to 
generate highly minute image data, an image projection means to have two or more projectors for 
projecting a part of above-mentioned highly minute image data [ at least ], and an image-processing 
means to choose and process a part of above-mentioned highly minute image data [ at least ], and to 
output to two or more above-mentioned projectors. 

[Claim 2] The above-mentioned image-processing means is an image projection system according to 
claim 1 characterized by to provide further a parameter storage means memorize a parameter required 
for the processing for projecting an exact image by two or more above-mentioned projectors, and an 
image division / processing means are based on the above-mentioned parameter, divide and process the 
above-mentioned image data, and output to two or more above-mentioned projectors. 
[Claim 3] Above-mentioned claim 1 characterized by providing further an image pick-up means to be 
arranged near a spectator's view and to photo a projection image, and a parameter calculation means to 
compute the above-mentioned projector arrangement parameter from the image data which photoed the 
above-mentioned projection image with the above-mentioned image pick-up means, or an image 
projection system according to claim 2. 



[Translation done.] 



http://ww4.ipdl.jpo.go.jp/cgi-bin/ta^ 9/15/2004 



Page 1 of 13 



* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 **** s hows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the image projection system which compounds the 
image of two or more projectors on a screen, and realizes projection of a high definition image. 
[0002] 

[Description of the Prior Art] By the presentation conventionally performed for a lot of people, it is an 
overhead projector (OHP;Over Head Projector). The slide has been used. On the other hand, the 
presentation system which combined the personal computer and the projection display (a projector is 
called hereafter) has come to be adopted with the spread of the latest personal computers, and fullness of 
application software. This system feature is in the color currently seen in the creation phase being 
obtained as it is, when it is that the time and effort which prints the image and manuscript which were 
drawn up on the personal computer on an OHP sheet, or photos them to a reversal film can be saved, 
especially a natural image. CRT display of especially the former in such a projector (Cathode Ray Tube 
dislay monitor) It compares, and it is more lightweight and the projector using a liquid crystal panel with 
little complicatedness of installation is used for the core. 

[0003] Here, an example of the presentation system which combined the personal computer and the 
liquid crystal projector is shown and explained to drawing 23 . In this drawing, the image and 
manuscript data created on the personal computer 201 branch from a monitor output, and are outputted 
to the processing control section 206 of a liquid crystal projector 202. In the processing control section 
206 of a liquid crystal projector 202, this inputted data is processed and it is outputted to a liquid crystal 
panel (LCP) 204. In a liquid crystal panel 204, the image according to this input image data is displayed. 
And the light from the light source 203 is projected on a screen 208 through a projector lens 207, after 
the amount of transparency is determined by the gradation of the image displayed on the liquid crystal 
panel 204. 
[0004] 

[Problem(s) to be Solved by the Invention] However, the resolution of the image projected by the above- 
mentioned liquid crystal projector is determined by the number of pixels of a liquid crystal panel. 
Although the projector which can input current and the picture signal beyond the resolution of a liquid 
crystal panel exists, since subject-copy image data are thinned out in order to double with the number of 
pixels of a liquid crystal panel, the resolution of a subject-copy image has not been employed efficiently. 

[0005] Furthermore, the projector which displays one part of a subject-copy image and projects the 
whole by scrolling also has the fault that the whole cannot be seen in 1 time of a certain thing. In order 
to solve this problem, when obtaining a higher definition projection image, the number of pixels of a 
liquid crystal panel must be increased, but since such a high definition liquid crystal projector will 
become very expensive, it is not suitable for generally being used widely. 

[0006] Moreover, when the liquid crystal panel of high resolution is used, the load of a processing 
control section also increases. Furthermore, the area of the control section on a panel becomes large, the 



http : //www4 . ipdl j p o . go j p/cgi -bin/tran_web_cgi_ej j e 



9/15/2004 



Page 2 of 13 



utilization effectiveness of light source light falls as a result, and a projection image has the fault of 
becoming dark. 

[0007] Furthermore, since conditions, like the right pair must be carried out are needed for installing a 
projector body at a level with accuracy, and a screen in order to project an exact image, when 
installation of a projector is not exact, a projection image will rotate or will become what the 
phenomenon of the "gate" generally said produced. 

[0008] Moreover, in JP,2-306782,A, the technique which inserts the image (fitting image) beforehand 
prepared for some sets photoed with the TV camera is indicated. To a fitting image, this technique 
produces the gate according to the direction of a camera artificially, and is inserted in the image of a TV 
camera (this conversion is called primary transparent transformation). With this technique, when the 
coordinate in (x, y), and the image of a TV camera is set to (X, Y) for the coordinate on a fitting image, 
primary transparent transformation is expressed by the degree type (1). 
[0009] 

X=m and (d-x+e-y+f)/(a-x+b-y+c) 
Y=m and (g-x+h-y+i)/(a-x+b-y+c) (1) 

However, when it is going to apply this technique to the projection image of a projector, the problem 
which is not taking the revolution of an image into consideration about conversion of the above- 
mentioned (1) formula of needing a means to detect the projection direction of a projector will arise. 
[0010] This invention combines the controller section which divides a personal computer, and two or 
more projectors and a high definition input image, and outputs a picture signal to each projector, and the 
place which it was made in view of the above-mentioned problem, and is made into the object has it in 
obtaining the high definition projection image which employed the resolution of input data efficiently. 
[0011] 

[Means for Solving the Problem] in order to attain the above-mentioned object - the 1st voice of this 
invention — the image projection system which twists like is characterized by to provide an image 
generation means generate highly minute image data, an image projection means have two or more 
projectors for projecting a part of above-mentioned highly minute image data [ at least ], and an image- 
processing means chooses and processes a part of above-mentioned highly minute image data [ at least ], 
and output to two or more above-mentioned projectors. 

[0012] and the 2nd voice — the image projection system which twists like carries out providing further a 
parameter storage means memorize a parameter required for processing for the above-mentioned image- 
processing means to project an exact image by two or more above-mentioned projectors, and an image 
division / processing means are based on the above-mentioned parameter, and divides and processes the 
above-mentioned image data and output it to two or more above-mentioned projectors as the description. 

[0013] Furthermore, the image projection system by the 3rd mode is characterized by providing further 
an image pick-up means to be arranged near a spectator's view and to photo a projection image, and a 
parameter calculation means to compute the above-mentioned projector arrangement parameter from the 
image data which photoed the above-mentioned projection image with the above-mentioned image pick- 
up means. 

[0014] The above 1st thru/or the 3rd mode do the following operations so. namely, the 1st voice of this 
invention — in the image projection system twisted like, highly minute image data is generated by the 
image generation means, and a part of above-mentioned highly minute image data [ at least ] is chosen 
and processed by the image-processing means, it is outputted to two or more above-mentioned 
projectors, respectively, and a part of above-mentioned highly minute image data [ at least ] is projected 
by image projection means to have two or more projectors. 

[0015] and the 2nd voice ~ in the image projection system twisted like, in the above-mentioned image- 
processing means, it is based on the above-mentioned parameter with image division / processing means 
by memorizing a parameter required for the processing for projecting an exact image by two or more 
above-mentioned projectors, and the above-mentioned image data is divided and processed and is 
outputted to two or more above-mentioned projectors by the parameter storage means. 
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[0016] Furthermore, in the image projection system by the 3rd mode, the above-mentioned projector 
arrangement parameter is computed from the image data which the projection image was photoed by the 
image pick-up means arranged near a spectators view, and photoed the above-mentioned projection 
image with the above-mentioned image pick-up means with the parameter calculation means. 
[0017] 

[Embodiment of the Invention] Hereafter, the gestalt of operation of this invention is explained with 
reference to a drawing. The image projection system first applied to the gestalt of operation of the 1st of 
this invention is explained. Drawing 1 is drawing showing the image projection structure of a system 
concerning the gestalt of the 1st operation. 

[0018] As shown in this drawing, the image projection system concerning the gestalt of this operation 
consists of a personal computer (it is hereafter written as a personal computer) 1 which draws up another 
****, and an image and a manuscript greatly, and outputs the highly minute image data 2, the highly 
minute projector controller section 3 which processes and divides the highly minute image data 2 from a 
personal computer 1, and outputs it, and two or more projector 7a thru/or 7d. 
[0019] The above-mentioned highly minute projector controller section 3 consists of an image 
processing and the division section 4, and the projector arrangement storage section 5 and the D/A 
converter 6 further. Furthermore, although not illustrated here, the control section which controls each 
function is also contained. 

[0020] It sets in such a configuration and the highly minute image data 2 created and outputted with the 
personal computer 1 is outputted to the image processing and the division section 4 of the controller 
section 3. In this image processing and division section 4, it is determined whether to output the part of 
highly minute image data 2 throat to each projector based on the parameter beforehand memorized by 
the projector arrangement storage section 5, and predetermined processing is performed. The detail 
about the function or operation of each component of the parameter memorized by this projector 
arrangement storage section 5, and an image processing and division section 4 grade is mentioned later. 
[0021] After the signal of the above-mentioned image processing and division section 4 is outputted to 
two or more D/A converters 6 and changed into an analog signal by this D/A converter 6, an image is 
projected by each projector 7a thru/or 7d on a screen 8. In this way, the projection image projected on 
the screen 8 turns into a high definition image with which alignment of each image was carried out to 
accuracy. 

[0022] Here, when the screen 8 has not carried out a right pair to the above-mentioned liquid crystal 
projector 7 with reference to drawing 2 , the technique of there being no gate and making the whole 
projection image exact is explained. When the screen 8 has not carried out a right pair to the above- 
mentioned projector 7, scale factors will differ in each part of a projection image, and it will become an 
image with a "gate" as shown in drawing 2 (a). The distance d of the projector 7 and screen 8 with which 
how it is projected on a screen 8 met the optical axis of a projector 7 The include angle theta which the 
flat surface determined with the optical axis of perpendicular C-S and a projector which took down the 
optical axis from the angle of rotation omega of the projector 7 when considering as a revolving shaft 
and the origin/datum C of a projector 7 to the screen 8 makes with ZX flat surface (direction which a 
gate produces) It is determined at the include angle (gate angle) phi which the optical axis of 
perpendicular C-S and a projector 7 makes. 

[0023] The coordinate which made the image core Zero o on the image inputted into a projector 7 now 
(x y), When the point that the optical axis of a screen and a projector crosses like drawing 2 is made into 
Zero O and the coordinate which took the Z-axis in the Y-axis and the direction of a normal of a screen 
to the X-axis and a perpendicular direction to the screen up horizontal direction is set to (X, Y0), The 
relation between (x, y), and (X, Y) is expressed to the following (2), (3), and (4) types. 
[0024] 
[Equation 1] 
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[0025] In the above-mentioned formula, T of a matrix right shoulder shows transposition and m is a 
scaling factor decided by the distance d with a screen. R is a matrix showing the revolution by theta, phi, 
and omega, and Coordinate C is a location in the above-mentioned XYZ system of coordinates of the 
reference point of a projector. 

[0026] Counting backward from this d, theta, phi, and omega, the image projected with generating and 
outputting the image which amended the gate as beforehand shown in drawin g 2 (b) becomes what has 
the whole exact at the rate of actual size. This situation mentions later. Moreover, although explained 
having determined the projection condition from d, theta, phi, and omega here, if a projection condition 
can describe and amend at accuracy, of course, the group of other parameters is sufficient. 
[0027] Drawing 3 is drawing showing the relation between a subject-copy image and the output image 
to each projector. Drawing 3 (a) is a high definition subject-copy image compared with the resolution of 
a projector, and is outputted to two sets of the projectors which project this image by physical 
relationship as shown on a screen at drawing 3 (b). in this case - if the image of the part [ image / of a 
left-hand side projector ] downward shifted is outputted to a right-hand side projector as shown in 
drawing 3 (c) - a screen top - drawing 3 (d) - like - as a whole - a subject-copy image and 
abbreviation — the same image is projected. 

[0028] Moreover, the lamination technique of the image indicated by for example, the Japanese-Patent- 
Application-No. No. 141246 [ six to ] official report is used for the part to overlap, and it takes 
adjustment. A part for a joint is smoothly connectable with applying the processing technique of the 
duplication part of two or more images, multiplying by the multiplier as shown in the value of a subject- 
copy image at drawing 3 (e), and outputting to a projector. 

[0029] In this way, the joined example is shown in drawing 3 (f). In this drawing 3 (f), one line (for 
example, line which connects A-B in drawing 3 ) of the image of two sheets is shown by the broken 
line, respectively. A continuous line is the value of the image with which it was projected when applying 
and outputting the multiplier shown in drawing 3 (e) to each data value. Although drawing 3 (b) 
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explained as the scale factor of a projector being the same, when scale factors differ, it can respond by 
changing the magnitude of the part chosen by drawing 3 (c). 

[0030] The above approach can be similarly applied, when using two or more sets of projectors. 
Furthermore, although a moire phenomenon may happen from the difference in the case where the pixel 
of liquid crystal is clearly projected on a projection image, and it becomes an image hard to see, and the 
scale factor of each projector, in an overlap part since the pixel of a liquid crystal panel is comparatively 
coarse, these phenomena can make the focus of a projection image somewhat sweet, and can prevent it 
by making a pixel fade etc. Moreover, as long as it is smoothly joinable, for example, you may make it 
change nonlinear like a sin function, although the multiplier by which it multiplies in an overlap part 
was changed to linearity in drawin g 3 . 

[0031] The technique of gate amendment image generation is shown in drawing 4 , and it explains to it. 
Drawing 4 (a) shows a projection image and drawing 4 (b) shows the image data inputted into a 
projector. Field Sq surrounded by qO, ql, q2, and q3 of drawing 4 (b) Field SQ where the greatest image 
which can be inputted into a projector is shown, and the projection image is surrounded by Q0, Ql, Q2, 
and Q3 of drawing 4 (a) It corresponds. 

[0032] Field SP surrounded by P0, PI, P2, and P3 to which it added shading by drawing 4 </A> (a) 
Field SP which is a field used for actual projection and was surrounded by the projector input image P0, 
PI, P2, and P3 It corresponds. SP For a reference point, the straight line which made the point P0 that 
the include angle of two sides to make served as max, and was drawn respectively horizontally [ PI and 
P3 ] and vertically is SQ. It is the point which intersects each side and P2 is other three points and the 
point of making a rectangle. Moreover, the field Sp surrounded by P0, PI, P2, and P3 of drawing 4 (b) is 
a part corresponding to Sp among the images inputted into a projector. 

[0033] The pixel location (i, j) counted from the image core of a projector input image is changed into 
(Xi, Yj) by the above-mentioned (2) formula. Then, the value of a pixel location (i, j) uses the value of a 
pixel [ be / it / under / subject-copy image / which was chosen as each projectors like drawing 3 (c) / 
response (Xi, Yj) ]. When this time (Xi, Yj) is not an integer, a value is calculated by the well-known 
interpolation technique, such as linear interpolation and congruence Miyoshi interpolation. Moreover, 
after conversion, and (Xi, Yj) are SP. When you come outside, let a pixel value be zero. Here, it is SQ 
although Sp was determined as mentioned above. If it is inside, Sp can be set up in the location of 
arbitration, and magnitude. 

[0034] The detailed configuration of the image processing and the division section 4 which realizes the 
above-mentioned conversion is shown in drawing 5 , and it explains to it. In this drawing, an image 
processing and the division section 4 consist of the display image selection section 9, the interpolation 
section 10, and the multiplier setting-out section 1 1 further. As drawing 3 explained, this display image 
selection section 9 determines the part projected by each projector from the parameter storage section 12 
with reference to the parameter which determines the part which can be projected by this system in a 
subject-copy image, and outputs the image for two or more projectors. 

[0035] In the interpolation section 10, the parameter of the revolution of each projector, a shift, and a 
gate is read from the parameter storage section 12, and it deforms and interpolates and outputs so that a 
projection image with each output image of the display image selection section 9 exact on a screen may 
connect. Furthermore, the multiplier setting-out section 1 1 reads the overlap parameter of the projection 
image of each projector from the parameter storage section 12, and sets up the multiplier it was 
previously indicated to drawing 3 (f) that it was smoothly joined. The output image of the interpolation 
section 10 can be multiplied by this multiplier, and it is outputted to each projector through the D/A 
converter 6 as the last image. 

[0036] Drawing 6 shows the process in which a projection image is determined in image division / 
processing section 4, when a gate is in a projector on either side in addition to drawing 3 . In this 
example, in the right image, the gate arose in the longitudinal direction, and the gate has arisen aslant 
[ direction / upper right ] in the left image. ******** w hich the image with which both projection 
shifted since it was distorted like drawing 6 (a) unlike the subject-copy image when the same image as 
drawing 3 (c) was projected in this condition is observed. Then, it changes with the gate parameter 
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memorized in the parameter storage section 12 that this problem should be solved, and an image like 
drawing 6 (b) is projected. Thereby, a highly minute image faithful to a subject-copy image is obtained 
on a screen like drawing 6 (c). 

[0037] In addition, although explained with the gestalt of this operation sending data to a projector with 
an analog signal, when the input terminal of a digital signal is in a projector, outputting with digital data 
is possible, and, of course, a D/A converter is unnecessary. 

[0038] Next, the image projection system concerning the gestalt of the 2nd operation of this invention is 
explained. The gestalt of this 2nd operation adds further the part which computes the parameter which 
determines arrangement of a projector as the gestalt of the 1st operation. 

[0039] Drawing 7 is drawing showing the image projection structure of a system concerning the gestalt 
of the 2nd operation. As shown in this drawing, the gestalt of this operation consists of the controller 
section 21, a projector 28, and a digital camera 29 greatly. The above-mentioned digital camera 29 is 
arranged near the location of those who look at a presentation etc. actually, and can photo a projection 
image 30 now. The image change section 26 is changed in the case of setting out, and the criteria image 
generated in the criteria image generation section 25 is projected on it. 

[0040] This projected criteria image is photoed with a digital camera 29, and after that image is inputted 
into the projector arrangement parameter calculation section 24 of the controller section 21, the 
parameter (d, theta, phi, omega) which opts for arrangement of a projector is computed. 
[0041] In this way, the computed parameter is memorized by the projector arrangement storage section 
23, and when required, reading appearance of it is carried out to an image processing and the division 
section 22. An image processing and the division section 22 create the image outputted to a projector 28 
through the D/A converter 27 using the parameter by which reading appearance was carried out. In 
addition, although things are done, the thing which generate a criteria image in the case of setting and 
for which the criteria image generation section 25 may be constituted as the criteria image storage 
section is natural here. 

[0042] The detailed configuration of the above-mentioned parameter calculation section 24 is shown in 
drawing 8 , and it explains to it. The parameter calculation section 24 consists of the amount calculation 
section 30 of gates, overlap and the rotation calculation section 31, the gate amendment section 32, and 
the image memory section 33 in this drawing. 

[0043] In such a configuration, the image photoed with the digital camera 29 is temporarily memorized 
in the image memory section 33, when required, reading appearance is carried out, and it is compared 
with a criteria image by the amount calculation section 30 of gates, and a gate parameter is determined. 
A gate parameter is inputted into the gate amendment section 32 while it is outputted to the parameter 
storage section. 

[0044] In the gate amendment section 32, it amends in the image which photoed the projection image by 
which the gate was amended in the image photoed with the digital camera 29 based on the gate 
parameter. In overlap and the rotation calculation section 31, a revolution and overlap of the projection 
images of each projector are computed from this image, and it outputs to the parameter storage section 
23. 

[0045] The projection image 30 projected in case a photograph is taken with a digital camera 29, in 
order to compute a parameter will not ask the gestalt, if accuracy is asked for the above-mentioned 
parameter by known images, such as a thing, a grid pattern, etc. that the luminescent spot and a cross 
joint were arranged in fixed spacing. 

[0046] At this time, the approach of projecting a reference image in order by two or more projectors 28, 
and determining a parameter for every set, and the color of an image to project are changed and 
projected on each projectors, a color can be specified from the image captured with the digital camera 
29, and the parameter of each projector can also be determined. 

[0047] The technique of computing a parameter by indicating hereafter the straight line which changed 
the include angle by another **** in the gestalt of the 2nd operation with reference to drawing 9 at 
multiple times is explained. Include-angle alpham of since level [ through an image core / in the segment 
of die-length L ] to a projector 28 The segment on the image photoed when it changed and was 
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displayed as m= 0, 1 and 2, and - (refer to drawing 9 (a)) is die-length L f m and include-angle alpha'm. 
Suppose that it was observed. Here, it is alpha'm. They are an include angle from a horizontal, and L'm 
in the photoed image. It divides into distance Llm from a core to an endpoint, and L2m (L f m =L1 
m+L2m). The angle of rotation omega of an image is expressed with the following (5) types at this time. 

[0048] 

Omega=alpha , m -alpham (5) 

Moreover, a segment 2 is L'm here. Supposing it becomes max inside, the direction theta which a gate 
produces is shown by the degree type. 
Theta=alpha 2 (6) 

Furthermore, Llm and L2m are standardized by (L/L'k), using as k the direction which intersects 

perpendicularly with a segment 2. 

[0049] 

llm==Llm*(L/L'k) 
12m=Llm*(L/L'k)(7) 

Parameters phi and d are called for by the following (8) formulas from these. 
[0050] 

[Equation 2] 

lU+12tn 

coi0« L 

2 • lira* 1 2m 

2 • 1 !■ • 1 2i 

d = • sift^ (8) 

I 1 In- 1 2d I 

[0051] Next, with reference to drawing 10 , the case of the lattice point is explained as an example of the 
projection image 30 projected in case a parameter is computed. In this drawing, the part by which the 
field surrounded by the dotted line was surrounded as the projection image of a projector and the 
continuous line shows the photographic coverage of a digital camera 29, respectively. Moreover, a part 
of projection image on either side overlapped, and the gate has produced the left image in the vertical 
direction. 

[0052] First, the location corresponding to the lattice point on either side is computed by approaches, 
such as binary-izing and pattern matching, from the image 101 photoed with the digital camera. 
Moreover, it is the location and spacing dl on the image of a digital camera, and d2 within projection 
image of one of the two ( drawing 10 left projection image). From a lattice point location and spacing 
[ on the image data of — actually inputted into a projector as a ratio ] w [pixel], it can ask for each 
parameter of the above-mentioned (2) formula, and a gate can be amended. 
[0053] Moreover, since a location when the lattice point is inputted into a projector is known, the 
physical relationship of both the projection images on a screen is calculable from shift-amount [ on the 
image 101 of a digital camera ] s. 

[0054] As long as resolution is enough, you may make it photo the whole, although this drawing 10 
explains that near the overlap of both projectors is photoed with a digital camera. Moreover, rough count 
can be carried out by the image which also incorporated and began the control section of a camera and 
photoed the whole, and a parameter can also be determined as accuracy by the image which expanded 
and photoed the part in a degree. Furthermore, the image to project can be transformed little by little and 
the successive approach (for example, steepest descent method) to which feedback is applied so that the 
image which photoed the projection image may approach an ideal photography image can also be used. 
[0055] Moreover, when the above-mentioned gate becomes large, a focus can be avoided because the 
effect of a gap includes the optical system called a gate correcting lens in that case although it becomes 
large in a projector lens. 
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[0056] Next, other configurations of the parameter calculation section 24 are shown in drawing 1 1 , and 
it explains to it. This newly adds the distortion amendment section 35 which amends distortion of the 
image of a digital camera. Since other configurations are the same as that of drawing 8 , explanation is 
omitted. 

[0057] general — a camera lens — a tooth space -- a variant distortion arises in many cases. However, in 
order to determine a parameter from the image which photoed the projection image in the system of this 
invention, it is not desirable for the above-mentioned distortion to exist. Then, a parameter is 
computable to accuracy by amending distortion of an image, before using for parameter calculation. 
Amendment of distortion is easily realizable if it is the format whose digital camera records the focal 
location of a lens. 

[0058] Although the image data which photoed the projection image is inputted into the direct projector 
arrangement parameter calculation section 24 from the digital camera 29 in this 2nd example, it is also 
possible to input into off-line to the projector arrangement parameter calculation section 24 using media, 
such as a floppy disk and a PC card. 

[0059] Moreover, although the digital camera was used and explained to photoing a projection image, 
the system of this invention is realized because a common CCD camera and a video camera also prepare 
an image input board and the A/D-conversion section. 

[0060] Next, the image projection system concerning the gestalt of the 3rd operation is explained. The 
example which carries out the pointing of the focus of the projection [ put and ]-with rod image on 
screens, such as top-most vertices and the lattice point, which formed the high brightness LED at the 
head, and picturizes it is shown in drawing 12 , and it explains to it. 

[0061] In this example, since the point which carried out pointing compared with the projection image is 
made very brightly, the extract of the photography image of a digital camera to the focus becomes easy. 
Moreover, pointing may be carried out with a laser pointer instead of the high brightness LED. 
[0062] Drawing 13 shows the example which formed the pointing device in the projector, and explains. 
As shown in this drawing, an image is displayed on LCP43 and the light from the light source 42 is 
projected on a screen 50 through LCP43, optical system 44, and a projector lens 45. It is reflected by 
mirrors 48 and 49 and the laser beam (a dotted line shows by a diagram) which came out of 
semiconductor laser (LD) 46 is projected on a screen. 

[0063] The above-mentioned mirror 49 is a collapse type, when placing it on an optical axis as shown in 
drawing when carrying out the pointing of it, in order to determine a projection condition, and projecting 
an image, pushes down and is removed from on an optical axis. The processing control section 47 
adjusts the include angle of a mirror 48, and projects the luminescent spot of laser on a focus location 
while it controls LCP43 for image display. 

[0064] By placing a pointing device into a projector, the focus can be specified as accuracy and an 
automatic target. Moreover, the light source 42 and the utilization effectiveness of the light from LD46 
can be raised by making a mirror 49 into a collapse type. 

[0065] In addition, although here is explaining that a laser beam projects on a screen through LCP43, of 
course, a mirror 49 may be formed from LCP43 in a screen side. Furthermore, directing using a mouse 
etc. is possible, displaying the photography image data of a digital camera 29 with a personal computer, 
and if it can be specified as accuracy, the extract approach of the focus will not be asked. 
[0066] Drawing 14 is an example which determines a projection condition by arranging many minute 
photosensors on a screen. In this drawing, with a circle [ white ] shows the sensor which is a black dot 
and is not applied in the sensor which a projection image requires. Thus, the projection condition to a 
screen top can be understood by detecting the sensor by which light is irradiated. It is important that the 
parameter which can do a parameter in accuracy is computed, and, of course, the system of this 
invention can be constituted also from approaches other than the above. 

[0067] Next, the image projection system concerning the gestalt of the 4th operation is explained. The 
4th example is the high brightness and multi-gradation projector which used two or more projectors. 
Hereafter, this example is explained with reference to drawing 15 . 

[0068] In this drawing, the projection image 52 is projected for the image of two or more projectors 51 
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on accuracy in piles, if the completely same image is outputted from both projectors at this time, since it 
will be observed by twice [ in the case of projecting by one set on a screen ] as many brightness as this — 
the system of this invention — high — it functions as a brightness projector. 

[0069] Moreover, although image data is generally expressed by 256 gradation to each colors 0-255, in 
the system of this invention, the image of 255xN+l gradation can be expressed using the projector of N 
base. For example, when two sets of projectors are used, the data of the value of 1 14 input 57 and 57 
into each projector, and if it is made to say that a data value 317 inputs 159,158, the data of a maximum 
of 510 gradation (255 is inputted into both projectors) can be taken into consideration. 
[0070] Since alignment is automatically carried out from the image data which photoed the projection 
image with the view of those who see and an amendment image is outputted to a projector as this 
invention is in the gestalt of the 2nd operation, the system of this example is realized very simply. 
[0071] Moreover, the display of a solid image is also possible by distinguishing between the output 
image of each projector. Since all the resolution of a projector can be efficiently employed in the system 
of this invention, a high resolution solid image can be displayed compared with the former. 
[0072] Next, the image projection system concerning the gestalt of the 5th operation is explained, the 
circle shown in drawing 16 like the gestalt of this operation although the screen on a flat surface was 
assumed in each above-mentioned example -- this invention is effective even if it uses a spherical 
screen. 

[0073] That is, drawing 16 (a) is a projection system for a lot of people. Since such a system can display 
an image on the large range of a field of view, it can obtain high presence. Such a projection system can 
be set very easily using this invention. 

[0074] Moreover, as shown in drawing 16 (b), the application to personal projection equipment is also 
considered. Although there is an example which equips with the equipment called HMD (Head Mounted 
Display) as an object for individuals, and realizes the display of high presence, since this example does 
not need to equip with special equipment unlike HMD, it does not have a feeling of oppression etc. and 
can be seen comfortably. Furthermore, there is no need of seeing a display by point-blank range, and 
there is effectiveness — the image of high resolution is obtained from HMD with the small burden to an 
eye. 

[0075] Installation of a projector may be projected from under a spectator, as shown in drawing 16 (c) 
and (d), and it can also be projected from the upper and lower sides. Moreover, the display of a rear 
projection mold is also possible like drawing 16 (e). 

[0076] Since the image projection system concerning the gestalt of this 5th operation can amend a 
projection condition with the view of those who see, the point which can also set easily the projection to 
screens other than a flat-surface configuration is the description. 

[0077] Next, the image projection system concerning the gestalt of the 6th operation is explained. 
Drawing 17 is the example which combined the storage which memorizes the output image to each 
projector. As shown in this drawing, the controller section 61 adds the output image storage section 66 
to an image processing and the division section 62, the projector arrangement storage section 63, the 
projector arrangement parameter calculation section 64, and the D/A converter 65, and is constituted. 
[0078] In such a configuration, the output image to each projector created in an image processing and 
the division section 62 is once memorized by the output image storage section 66. In case it outputs to a 
projector, reading appearance is carried out one by one from the output image storage section 66. 
[0079] This output image storage section 66 may be formed in the exterior of the controller section 61. 
These storages can consist of HDD (Hard Disk Drive), a CD-ROM, a DVD (DigitalVideo Disc), etc. 
The image projection system concerning the gestalt of this 6th operation is effective when using the 
same image repeatedly. 

[0080] Next, the image projection system concerning the gestalt of the 7th operation is explained. It is 
also possible to process by software, as shown in drawing 18 . In this drawing, CPU75 reads the image 
processing and the division software 72, and the projector arrangement parameter 73 which were 
memorized by storages, such as a hard disk, amends and divides an image and the manuscript data 71, 
and creates projection data 77a and 77b-. 
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[0081] In this way, the created projection data 77 is outputted to projector 79a and 79b- through image 
I/O board 76. Moreover, a projector arrangement parameter is calculated by reading the image data 78 
for projector arrangement decision and the projector arrangement parameter calculation software 74 
which photoed the projection image with the video camera 80, and it memorizes to a storage. The image 
projection system concerning the gestalt of this 7th operation is effective, when it can realize cheaply 
compared with the case of hardware and you do not need an animation, or when an image can be 
prepared beforehand. 

[0082] Next, the image projection system concerning the gestalt of the 8th operation is explained. 
Although it is the gestalt of the 5th operation previously and the example of a rear projection type 
display was shown, the gestalt of this operation puts many small projectors (micro projector) in order, 
and realizes a high definition and a thin display. 

[0083] Drawing 19 is drawing explaining the gestalt of the operation which applied this system to the 
thin display. Image division / processing section 91, the parameter storage section 92, the parameter 
calculation section 93, the criteria image generation section 94, and the image change section 95 are the 
same as the above-mentioned example among the configurations of this drawing. Moreover, the image 
which photoed the projection image near the view to the spectator is inputted into the parameter 
calculation section 93. In this example, the display of the rear projection type projected on a screen 97 
from back is assumed. 

[0084] Using the micro projector 96 with the description of the gestalt of the 8th operation very smaller 
than the projector used in said example, although the projection range of each projector is limited, it is to 
constitute a large-sized display from putting a large number in order. 

[0085] Moreover, since the body of a display is small, each light source seldom needs the thing of high 
power. Therefore, although depth is small, since much displays are put in order, a very high definition 
image can be seen compared with the former. 

[0086] Drawing 20 is the example which constituted the micro projector 96 from red and green and blue 
laser in three primary colors. According to the image of memory 106, a driver 105 adjusts the include 
angle of mirror 104a thru/or 104c, each laser 101, or the output reinforcement of 103, and scans the 
direction of desired. The include angle of a mirror can fix the center section of the mirror to a flexible 
stanchion, and can be changed from a 2-way with an electromagnet. 

[0087] In this drawing 20 , although Isshiki is made to take charge of by one mirror, the scan of x 
directions and the direction of y is also controllable by the mirror of each two colors, respectively. Since 
green and blue semiconductor laser is also increasingly put in practical use recently following red, 
compared with an output unit, then a screen size, the short display of depth is [ the very small scanning 
mold projector using these semiconductor laser ] realizable. 

[0088] Moreover, a micro projector is [ an LED array and ] Digital. Micromirror Constituting using the 
component called Device (DMD) is also possible. Next, the image projection system concerning the 
gestalt of the 9th operation is explained. 

[0089] Amendment of an image can also use the optical system for adjustment before a projector. 
Hereafter, the gestalt of the 9th operation is explained with reference to drawing 22 . In this drawing, it 
is the same as that of each aforementioned example to compute a parameter required for exact projection 
of the controller section 121 from the image which consisted of image division / processing section 122, 
the parameter storage section 123, the parameter calculation section 124, the image change section 126, 
and a D/A converter 127, and photoed the projection image with the digital camera 125. 
[0090] In addition to it, with the gestalt of the 9th operation, the adjustment optical system 128 and the 
adjustment optical-system control section 129 are newly added. The adjustment optical-system control 
section 129 drives the adjustment optical system which carried out based on the parameter memorized 
by the parameter storage section, and was newly prepared in the front face of a lens of a projector so that 
an exact projection image may be connected on a screen. The adjustment optical system 128 consists of 
a lens group with forward refractive power, and a lens group with negative refractive power, and if there 
is a device of a shift and a tilt, the shift of an image required for this system, a gate, and a focus blank 
can be adjusted. 
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[0091] Here, the example of image shift adjustment is shown in drawing 21 as an example. A lens is in 
the location to which it added shading by beginning, and if a LCD side is on an optical axis, on a screen, 
a projection image will be connected to the location of 1 13. If a lens is shifted from this condition up, a 
projection image will be made in the location of 1 14 on a screen. Moreover, although not shown in 
drawing, it instigates and a focus blank can be amended by adjustment of a tilt or two lens group 
spacing. 

[0092] Although the gestalt of this 9th operation explained that it amended only by optical system, it is 
also possible to combine with amendment processing in image division / processing section. Although 
explanation of the gestalt of the above operation did not describe, it is applicable instead of LCD also at 
the projector using CRT. 

[0093] The gestalt of the operation explained above acquires the following effectiveness. That is, high 
resolution manuscript and image can be displayed from the liquid crystal panel used for the projector by 
dividing and projecting highly minute image data on the 1st in this system at two or more projectors. 
Since dividing and projecting highly minute image data on the 2nd at two or more projectors creates the 
output image to each projector based on the projection condition memorized beforehand, projection after 
adjustment can be performed automatically. Since the image which amended the gate etc. as an image 
projected on the 3rd by each projector is outputted, a projection image faithful to a subject-copy image is 
obtained. 

[0094] The parameter which takes a photograph with the image pick-up equipment which placed the 
projection image of two or more projectors near a spectator's view location the 4th, and amends the 
physical relationship of projectors and deformation of a projection image automatically from the 
obtained image data is computable. Therefore, the highly minute projector using two or more projectors 
can be set very easily. Calculation of a projector arrangement parameter becomes easy by capturing the 
image which directed the focus of a projection image with the pointing device which has brightness 
sufficiently higher than image data, such as the high brightness LED and a laser pointer, in the 5th. 
[0095] By forming a pointing device in a projector the 6th, the focus on a projection image can be 
specified as accuracy and an automatic target. Since it can perform easily putting the projection image of 
two or more projectors on the 7th at accuracy, it can use as a high brightness projector or a multi- 
gradation projector. Since the system of this invention can evaluate a projection image with the view of 
those who see, it can also perform [ 8th ] easily setting projected to the screen which carried out 
configurations other than a flat surface. It has the screen of a transparency mold in the 9th, and using the 
projector of the scanning mold using semiconductor laser as projection equipment can realize a very thin 
shape display by very easy setting. 

[0096] When using for the 10th over multiple times by having the output image storage section which 
memorizes the output image to each once created projector, it is not necessary to recalculate to 
whenever [ the ]. It becomes possible to compound the projection images from each projector including 
the focus blank of a projection image on a screen to accuracy by including adjustment optical system in 
the 1 1th at an image projection means. 

[0097] In addition, it is as follows when the summary of this invention is summarized. 

(1) an image generation means to generate highly minute image data, the image projection means 
containing two or more projectors which project said a part of highly minute image data [ at least ], and 
the image-processing means for choosing and processing said a part of highly minute image data [ at 
least ] to said two or more projectors, and outputting it to them — since ~ the image projection system 
characterized by becoming. 

[0098] This mode corresponds to the gestalt of the 1st operation. According to this system, by the 
system of this invention, high resolution manuscript and image can be displayed from liquid crystal 
panel CRT used for the projector by dividing and projecting highly minute image data on two or more 
projectors. Furthermore, since dividing and projecting highly minute image data on two or more 
projectors creates the output image to each projector based on the projection condition memorized 
beforehand, projection after adjustment can be performed automatically. 

(2) a parameter storage means memorize a parameter required for processing for said image-processing 
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means to project an image without distortion by two or more of said projectors, and an image division / 
processing means is based on said parameter, and divides and processes said image data and output it to 
two or more of said projectors — since — an image projection system given in the above (1) 
characterized by to become. 

[0099] This mode corresponds to the gestalt of the 1st operation. According to this system, by the 
system of this invention, high resolution manuscript and image can be displayed from liquid crystal 
panel CRT used for the projector by dividing and projecting highly minute image data on two or more 
projectors. Furthermore, since dividing and projecting highly minute image data on two or more 
projectors creates the output image to each projector based on the projection condition memorized 
beforehand, projection after adjustment can be performed automatically. 

(3) The above (1) characterized by to have further a parameter calculation means compute the 
arrangement parameter which is the arrangement information over the screen of said projector from an 
image pick-up means photo the projection image on the screen which said image projection means 
projected near a spectator's view, and the image data which photoed the projection image with said 
image pick-up means, or an image projection system given in (2). 

[0100] This mode corresponds to the gestalt of the 2nd operation. Since the image which amended the 
gate etc. as an image projected by each projector is outputted according to this system, a projection 
image faithful to a subject-copy image is obtained. Furthermore, the parameter which takes a photograph 
with the image pick-up equipment which placed the projection image of two or more projectors near a 
spectator's view location, and amends the physical relationship of projectors and deformation of a 
projection image automatically from the obtained image data is computable. Therefore, the highly 
minute projector using two or more projectors can be set very easily. 

(4) Said projector arrangement parameter is an image projection system given in the above (3) 
characterized by being computed from the image data which photoed the known pattern projected from 
one set or more than it among said two or more projectors with said image pick-up equipment. 
[0101] This mode corresponds to the gestalt of the 2nd operation. Since the image which amended the 
gate etc. as an image projected by each projector is outputted according to this system, a projection 
image faithful to a subject-copy image is obtained. Furthermore, the parameter which takes a photograph 
with the image pick-up equipment which placed the projection image of two or more projectors near a 
spectator's view location, and amends the physical relationship of projectors and deformation of a 
projection image automatically from the obtained image data is computable. Therefore, the highly 
minute projector using two or more projectors can be set very easily. 

(5) Said projector arrangement parameter is an image projection system given in the above (3) 
characterized by being computed from the image data which photoed the image by which pointing was 
carried out in the focus on the screen with said image pick-up equipment. 

[0102] This mode corresponds to the gestalt of the 3rd operation. According to this system, calculation 
of a projector arrangement parameter becomes easy by capturing the image which directed the focus of a 
projection image with the pointing device with brightness sufficiently higher than image data, such as 
the high brightness LED and a laser pointer. Furthermore, the focus on a projection image can be 
specified as accuracy and an automatic target by forming a pointing device in a projector. 

(6) Said projector arrangement parameter is an image projection system given in the above (3) 
characterized by being computed by the photosensor arranged on a screen. 

[0103] This mode corresponds to the gestalt of the 3rd operation. According to this system, the focus on 
a projection image can be specified as accuracy and an automatic target by sensing a projection image 
with the photosensor on a screen. 

(7) The projection image of two or more of said projectors is an image projection system the above (2) 
characterized by projecting the part same spatial completely in said image data on the same location of a 
screen, or given in (3). This mode corresponds to the gestalt of the 4th operation. 

[0104] Since it can perform easily putting the projection image of two or more projectors on accuracy, 
this system can be used as a high brightness projector or a multi-gradation projector. 

(8) The projection image of two or more of said projectors is an image projection system the above (2) 
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characterized by being projected on the screen which carried out configurations other than a flat surface, 
or given in (3). This mode corresponds to the gestalt of the 8th operation. 

[0105] Since this system can evaluate a projection image with the view of those who see, it can also 
perform easily setting projected to the screen which carried out configurations other than a flat surface. 

(9) The projection image of two or more of said projectors is an image projection system the above (2) 
characterized by projecting on the screen of a transparency mold, or given in (3). 

[0106] This mode corresponds to the gestalt of the 5th operation. Since this system can evaluate a 
projection image with the view of those who see, it can also perform easily setting projected to the 
screen which carried out configurations other than a reflective mold. 

(10) Patent claim 2 characterized by having further the output image storage section which memorizes 
the output image to said two or more projectors created in an image processing and the division section, 
or an image projection system given in 3. 

[0107] This mode corresponds to the gestalt of the 6th operation. When using over multiple times by 
having the output image storage section which memorizes the output image to each once created 
projector according to this system, it is not necessary to recalculate to whenever [ that ]. 

(11) Said image projection means is an image projection system the above (2) characterized by 
including further adjustment optical system with the work which adjusts the projection condition of two 
or more of said projectors, and compounds the projection image of each projector to accuracy on a 
screen, and the adjustment optical-system control section which controls said adjustment optical system, 
or given in (3). 

[0108] This mode corresponds to the gestalt of the 9th operation. According to this system, it becomes 
possible to compound the projection images from each projector including the focus blank of a 
projection image on a screen to accuracy by including adjustment optical system in an image projection 
means. 
[0109] 

[Effect of the Invention] According to this invention, the controller section which divides a personal 
computer, and two or more projectors and a high definition input image, and outputs a picture signal to 
each projector can be combined, and the image projection system which obtains the high definition 
projection image which employed the resolution of input data efficiently can be offered. 



[Translation done.] 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 **** s h ows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is drawing showing the image projection structure of a system concerning the gestalt of 
the 1st operation. 

[Drawing 2] When the screen 8 has not carried out a right pair to a liquid crystal projector 7, it is 
drawing for explaining the technique of making the whole projection image exact at the rate of actual 
size. 

[Drawing 3] It is drawing showing the relation between a subject-copy image and the output image to 
each projector. 

[Drawing 4] It is drawing showing the technique of gate amendment image generation. 

[Drawing 5] It is drawing showing the detailed configuration of an image processing and the division 

section 4. 

[Drawing 6] When a gate is in the image of a projector on either side, it is drawing showing the process 
in which a projection image is determined in image division / processing section 4. 
[Drawing 7] It is drawing showing the image projection structure of a system concerning the gestalt of 
the 2nd operation. 

[Drawing 8] It is drawing showing the detailed configuration of the parameter calculation section 24. 
[Drawing 9] In the gestalt of the 2nd operation, it is drawing for explaining the technique of computing a 
parameter by indicating the straight line which changed the include angle by another **** at multiple 
times. 

[Drawing 10] It is drawing for explaining the case of the lattice point as an example of the projection 
image 30 projected in case a parameter is computed. 

[Drawing 11] It is drawing showing other configurations of the parameter calculation section 24. 
[Drawing 12] In the gestalt of the 3rd operation, it is drawing showing the example which carries out the 
pointing of the focus of the projection [ put and / at a rod ] image on screens, such as top-most vertices 
and the lattice point, which formed the high brightness LED at the head, and picturizes it. 
[Drawing 13] In the gestalt of the 3rd operation, it is drawing showing the example which formed the 
pointing device in the projector. 

[Drawing 14] In the gestalt of the 3rd operation, it is the example which determines a projection 
condition by arranging many minute photosensors on a screen. 

[Drawing 15] It is drawing for explaining the image projection system concerning the gestalt of the 4th 
operation. 

[Drawing 16] It is drawing for explaining the image projection system concerning the gestalt of the 5th 
operation. 

[Drawing 17] In the gestalt of the 6th operation, it is drawing showing the example which combined the 
storage which memorizes the output image to each projector. 

[Drawing 18] It is drawing for explaining the image projection system concerning the gestalt of the 7th 
operation. 

[Drawing 19] It is drawing explaining the gestalt of the operation which applied the system concerning 
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the gestalt of the 8th operation to the thin display. 

[Drawing 20] It is drawing showing the example which constituted the micro projector 96 from red and 
green and blue laser in three primary colors. 

[Drawing 21] It is drawing for explaining the example of image shift adjustment by the gestalt of the 9th 
operation. 

[Drawing 22] It is drawing showing the image projection structure of a system concerning the gestalt of 
the 9th operation. 

[Drawing 23] It is drawing showing the image projection structure of a system concerning the 
conventional technique. 
[Description of Notations] 

1 Personal Computer 

2 Highly Minute Image Data 

3 Projector Controller 

4 Image-Processing Division Section 

5 Projector Arrangement Storage Section 

6 D/A Converter 

7 Liquid Crystal Projector 

8 Screen 
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[Drawing 11 
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[Drawing 3] 
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[Drawing 5] 
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[Drawing 6] 
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[Drawing 14] 
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[Drawing 8] 
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[Drawing 121 
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[Drawing 13] 
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[Drawing 15] 
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[Drawing 20] 
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[Drawing 16] 
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[Drawing 18] 
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[Drawing 21 ] 
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[Drawing 22] 
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[Drawing 23] 
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